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ABSTRACT 



An electronic camera includes an image pickup device for 
receiving an image and outputting an image signal corre- 
sponding thereto. A connector is provided for receiving a 
control program from an external source. A memory is 
provided for permanently storing a built-in control program, 
and for temporarily storing the external source control 
program. A selection device is provided for designating one 
of the stored built-in control program and the external source 
control program. Signal processing circuitry is provided for 
processing the image signal output from the image signal 
pickup means in accordance with the control program des- 
ignated by the selection means. Preferably, the built-in 
control program is a photography program, and the external 
source control program is a character recognition control 
program. Accordingly, the electronic camera is capable of 
performing both photography and character recognition 
functions. 

4 Claims, 9 Drawing Sheets 



CAMERA BODY 



ceo ^ 



PRE- 
PROCESSING 



A/0 



RAM 





.10 




DMA 

CONTROLLER 




cpy 




E^PROM 



ROM 



EXTERNAL 
CONNECTOR 



RECORDING 
MEDIUM 





DISPLAY 




OPERATION 




UNIT 




MEANS 



14 



CABLE 










04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 



Sheet 1 of 9 



6,040,856 



OO 
CO 



o 

LU 



CO 



CD 



tn 



in 



CO 
CO 



q: c5 

O >-H 

o o 



I 



o 



>- 






q: 






o 












LU 










cr 


i 


LU 




-J 






—1 






o 


CO 




cc 


CO 




h- 


LU 




z 


O 




o 


o 




o 


cr 






a. 




>- 






cr 


♦ 


o 










LU 










< 


















o 

cc 



o 

o 



LU 
h- 

CO 

>- 

CO 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 



Sheet 2 of 9 



6,040,856 




oc: 
—J o 



/ LU 



LU O 



o 
oc 



GO 



o 
o 



oo 



C3 



OC 



C3 




CD 



CU I— 
CO HH 



CO 









1 — \ 
CO 
CO 


PRE- 


PROCE 



CO 



C-5 




04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 Sheet 3 of 9 



6,040,856 



FIG. 3 



(start ) 



1 


r 


SET MODE 1 




r 


SET MODE 2 




f 


SET MODE 3 


1 





SI 



S2 



.S3 



X 



84 



WRITE SETTING 
INFORMATION INTO 
E^PROM OF CAMERA 



T 



SET MODE n 


(n= 1, 2, 3. •'•) 






SET MAIN 


FILE OR 


ATTRIBUTE FILE 






SET BUILT-IN 


PROGRAM 


OR 


EXTERNAL 


PROGRAM 



BUILT IN 



S5 



S6 



S7 



EXTERNAL 



TO FIG. 4 



TO FIG. 5 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent Mar. 21, 2000 



Sheet 4 of 9 6,040,856 



FIG. 4 



S7' 



S8- 



IN CASE OF 
BUILT-IN PROGRAM 



sn 



S12- 



SET NATURAL IMAGE 
RECORDING OR BAR 
CODE RECORDING 



BAR CODE 



I. 



SET NUMBER OF 
RECORDING BITS 
PER ONE PIXEL 



SET NUMBER OF 
RECORDING PIXELS 



S13 



S14- 



SET GAMMA COMPRESSION 
CHARACTERISTIC 



SET COLOR IMAGE 
RECORDING OR MONO- 
CHROME IMAGE RECORDING 



COLOR 



SET RECORDING 
COLOR SPACE 
/Y:C = 4:2:2 
4:1:1 
VRGB. OR et al. 



S15 



S9- 



SET KIND OF BAR CODE 
MAN. 

,CODt 39. OR 
VNW-7 



S10- 



31 



SET WHETHER NATURAL 
IMAGE ALSO SHOULD BE 
RECORDED OR NOT 



SHOULD BE 
RECORDED 



MONOCHROME 



SET WHETHER 
COMPRESSION SHOULD 
BE DONE OR NOT 



NOT 



S16 



SHOULD BE DONE 



SET COMPRESSION 
RATIO 



817 



NOT 



RETURN 



■S18 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 



Sheet 5 of 9 



6,040,856 



IN CASE THAT 
THERE IS SETTING 
OPTION IN 
EXTERNAL PROGRAM 



FIG. 5 




EXTERNAL 

f 


SET FILE 
EXTERNAL 


NAME OF 
PROGRAM 




"^319 

r 


SET SETTING OPTION 
OF EXTERNAL PROGRAM 




^820 


RECORD SETTING OPTION 
OF EXTERNAL PROGRAM ON 
RECORDING MEDIUM 



RETURN 



321 

-822 



FIG. 6{ 




Qrei 

MODE KEY 



RELEASE 
KEY 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 



Sheet 6 of 9 



6,040,856 



FIG. 7 



FIG. 7A 



FIG. 78 



FIG. 7A 

(OEPRESSIMG RELEASE KEy)^S40I 



READ OUT SETTING 
INFORMATION OF MODE 
NUMBER FROM E'PROM 



BUILT-IN 



8403 



S419 




S402 



EXTERNAL 



BAR CODE ^ NATURAL 

IMAGE MODE OR BAR 
XODE MODE ? 



EXPOSURE 



EXPOSURE 



1 


|^S420 


\ 


READ OUT IMAGE SIGNAL 
FROM CCD AND TRANSMIT 
IT TO RAM 


READ OUT IMAGE SIGNAL 
FROM CCD AND TRANSMIT 
IT TO RAM 


♦ 






» 


^S406 


RECOGNIZE BAR CODE 










PRODUCE LUMINANCE 
SIGNAL 



READ OUT FILE NAME 
OF EXTERNAL 
PROGRAM FROM 
E'PROM 

i 



S423 



TRANSMIT REAO-OUT 
EXTERNAL PROGRAM 
FROM RECORDING 
MEDIUM TO RAM 



/ 



S424 



S407 



I 



SUBROUTINE-CALL 
ENTRY ADDRESS OF 
EXTERNAL PROGRAM 



1/ 



E 



S425 



(jnT) 



(A) 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 Sheet 7 of 9 



6,040,856 



FIG, 78 



® 



MONOCHROME 



S408 

COLOR 
IMAGE RECORDING 
OR MONOCHROME IMAGE 
RECORDING 

9 



COLOR 



PRODUCE COLOR SIGNAL 



RESAMPLING BY SET 
NUMBER OF RECORDING 
PIXELS 



3409 



8410 



COLOR CONVERSION INTO 
SET COLOR SPACE 



T 



1/ 



COMPRESSION INTO SET 
BIT LENGTH 



341 1 



3412 




YES 



d) 



04/07/2004, EAST Version: 1.4.1 



U.S. Patent 



Mar. 21, 2000 



Sheet 8 of 9 



6,040,856 



FIO. 8 



BAR CODE 
PROCESSING 



NON- 
COMPRESSION 



® 



COMPRESSION 



COMPRESSION 



S4U 



ATTRIBUTE 



S418 




ADDITIONALLY WRITE 
DATA INTO ATTRIBUTE 
FILE REGION OF MAIN 
FILE RECORDED 
IMMEDIATELY BEFORE 



c 



8416 
S414 

S426 



END 



3 



MAIN 



CREATE 


FILE 




r 


WRITE DATA INTO 
MAIN FILE REGION 




r 


WRITE FILE NAME 
OF CREATED FILE 
INTO E'PROM 



04/07/2004, EAST version: 1.4,1 



U.S. Patent 



Mar. 21, 2000 



Sheet 9 of 9 



6,040,856 



FIG. 9 



READ OUT SETTING FILE 
FROM RECORDING MEDIUM 



GET LANGUAGE FOR 
CHARACTER RECOGNITION 
FROM SETTING FILE 



READ OUT CHARACTER 
FONT OF GOTTEN 
LANGUAGE 



PERFORM EXPOSURE AND 
TRANSMIT IMAGE SIGNAL 
FROM CCD TO RAM 



CUT OUT CHARACTER AND 
PERFORM PATTERN 
MATCHING TO RECOGNIZE 
CHARACTER 



READ OUT FILE NAME OF 
FILE RECORDED 
IMMEDIATELY BEFORE, 
FROM E'PROM AND 
ADDITIONALLY RECORD 
CHARACTER RECOGNITION 
RESULT IN ATTRIBUTE 
FILE REGION OF READ- 
OUT FILE 

r 



( RETURN ) 



S501 



S502 



S503 



/ 



S504 



1/ 



S505 



[r 



S506 



04/07/2004, EAST Version: 1.4.1 



6,040,856 

1 2 

ELECTRONIC CAMERA CAPABLE OF FIG. 2 shows a block diagram of an embodiment of the 

PERFORMING PHOTOGRAPHY AND present inveation, 

CHARACTER RECOGNITION FIG. 3 shows a flow chart of a control program, 

FIG, 4 shows a flow chart continued from FIG. 3, 

This application is a continuation ofApplicationSer. No. 5 j c rrm a 

08/330,999 filed Oct. 28, 1994, now abandoned. ^ " ^'^^ """"""^ f™"" 

FIG. 6 illustrates a display state, 

BACKGROUND OF THE INVENTION comprising FIGS. 7A and 7B. shows a flow chart 

1. Field of the Invention of an operation at camera release, 

The present invention relates to an electronic camera. ^0 pIG. 8 shows a flow chart continued from FIG. 7, and 

2. Related Background Art FIG. 9 shows a flow chart of an example of an extern ally- 
A prior art electronic camera for digital recording is supplied program. 

constructed as shown in FIG. 1. 

In FIG. 1, an image passed through an optical lens 1 is ^^^S^.^!™^^^ 

picked up b; an ima|e pick-up devicr32 and processed for PREFERRED EMBODIMENTS 

CDS or AGC by a circuit 33, and amplified to a predetcr- piQ 2 shows a first embodiment, in which numeral 1 

mined level by a pre-ampUfier circuit 34. Then, the signal is denotes an optical system for focusing an optical image of 

passed through an A/D conversion circuit 5, a processing an object to be picked up, numeral 2 denotes a diaphragm/ 

circuit 5' and is temporarily stored in a memory 36. It is shutter for attaining proper exposure, numeral 3 denotes a 

compressed by a compression circuit 37 before it is recorded cCD for converting the focused optical image to an elec- 

on a medium 38. Numeral 39 denotes a memory controller jncal signal, numeral 4 denotes a pre-processing circuit for 

and numeral 40 denotes a system controller. correcting and amplifying an output from the CCD, numeral 

The electronic camera of this construction is suflQcient to 5 denotes an AD converter for converting a video signal to 

"photograph" an image but has a limitation as an apparatus 25 a digital signal, numeral 6 denotes a writable electric 

for acquiring further information. Namely, since it does not memory, numeral 7 denotes a read-only memory, numeral 8 

provide information as to detailed information of the denotes a recording medium for recording the video signal 

"photograph", a memory or memorandum of a photographer thereon, numeral 9 denotes a direct memory access (DMA) 

is required when the "photograph" is to be subsequently controller for transferring the digital data, numeral 10 

processed or edited, which significantly reduces efficiency. 30 denotes a CPU for controlling the system and for processing 

In such a prior art electronic camera, the contents of the the image data, numeral 11 denotes a writable non-volatile 

control process of the system controller is fixed on a ROM memory, numeral 12 denotes an external connector for 

as firmware, and the purpose photograph-recording of the exchanging information with an external device such as a 

camera is predetermined when it is manufactured in a plant, PC, numeral 13 denotes a display for displaying an operation 

and it cannot meet various sorts of requirements. 35 state of the camera to a user, and numeral 14 denotes a 

SUMMARY OF THE INVENTION ""f ^"'^'^j-'f ^J' 

When the camera of the present mvcntion is used, the user 

It is an object of the present invention to solve the ^^e operation thereof. 

problems encountered in the prior art electit^nic camera. ^^^^.^ operation, the external connector 12 is 

It is another object of the present mvcntion to allow 40 connected with a personal computer PC through a cable and 

mformation other than a "photograph" to be mciuded m an ^^^^^^^ ^^^^ ^gi^g a setting program on the PC. 

image file and to allow the generation of various sorts of - , „ ^ . r.i. 

. ^ . ^ J • c FIG. 3 shows a now chart of the settmg program mn on 

mformation without fixing a generation method m firmware. r» • .l- j r 

. ^ , . . . the PC. By using this program, the operation mode or the 

An embodiment of the present invention comprises a ^^^^^^ ^^^^^ invention may be sequentially set 

memory havmg a main file area such as an image file for 45 ^ ^ ^^^y 

recording an image, and an attribute file area for recording , , , ^. . . , , x. 

an attribute. It further comprises means for selecting and Whether a result of the process m the set mode (S5) is a 

storing camera control programs for image information (""^^e file) or an attribute file is set (S6). 

recording in the respective areas. The selected control pro- Whether a program for carrying out the operation mode is 

gram may be a built-in program or an externally supplied so built into the camera or is an externally-supplied program is 

program. Means may also be provided for transferring the set (S7), and if it is built-in (S7% whether it is a natural 

control program from recording medium when the external image recording or a bar code recording operation is set 

program is selected, and for controlling the camera in (S8), and if it is a bar code recording operation, a type of the 

accordance with the transferred program. bar code such as JAN code. Code 39 or ^fW-7 is determined 

TTius, information describing the image such as merchan- 55 (S9). Whether the natural image is also to be recorded or not 

dise management information represented by a bar code or (^10), if it is the natural image recording operation in 

title and names derived by character recognition can be ^8, the number of recording bits per pixel is set (Sll). The 

easily linked to a target image so that the apparatus is very ^^^er of recording pixels is then set (S12), a gamma 

useful as an input device for later retrieving or information- compression characteristic is thereafter set (S13). whether it 

managing the image 60 is a color image is set in step S14 or a monochromatic image, 

Otherobjectsandfeaturesofthepresentinventionwillbe ^""^1^^^%^^^' ^P^^L^^i/^f'^^^^S 

apparent from the following description of the invention and ^^^"^^^-^ ^i^^^ RGB) are se (S15). TTien m 

the accompanying drawings. S 16 whether it is to be compressed or not is set, and when 

" it IS to be compressed, a compression factor is set in S 17 and 

BRIEF DESCRIPTION OF THE DRAWINGS ^5 the process returns (S18). 

FIG. 1 shows a configuration of a prior art electronic In S7, if it is the external program, a file name of the 

camera. externally-supplied program is set (S19, FIG. 5), and if the 
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external program requires a setting option, the option of the If the mode is the determined to be the externally-supplied 

external program is set (S20), Then, in S21, the setting program mode in S403, a file name of the external program 

option of the external program is recorded on the recording is read from the EEPROM (S423) and the program of that 

medium and the process returns at S22. file name is read from the recording medium 8 and trans- 
After the settings of the routine of the operation mode 1 s ferred to the 6 (S424), and an entry address of the program 

have been completed, the settings for the operation modes 2, is sub-routme called (S425) to shift camera control to the 

3, . , , are performed in a similar fashion (S2, S3). externally-supplied program. 

After the setting of the operaUon modes 1, 2, 3, . . . have ^ setting file of the externaUy-supplied program to be 
been completed, the setting program on the PC is sent to the ^ executed is further read from the recording medium 8, as 
camera of the present invenUon through the cable to write ^° required. When the execution of the extemally-supplied 

the setting information in the EEPROM in the camera. Then, program is completed, the return command of the sub- 

the selling operaUon is terminated. ^^^ti^^ executed to return the control to the camera. 

Tlien, the user manipulates console buttons of the camera , ^'""^^y- ^^en it is determined in step S415 that the image 

of the present invention to choose the operation mode of the ,5 ^ .^^^ ^e stored m a mam file, the camera records the 

camera mformation processed by the image pick-up on the record- 

, ^ T ing medium as it is, and writes the file name in the EEPROM 

FIG. 6 shows manipulation buttons 61, 63 and an LCD (5416 S417 and 54261 

display panel 65 of the camera. FIGS. 7A, 7B and 8 show r o^^^ .1 ^ . ■ . ■ ,1 

fl™ /uowc «f o ^.rv^^ro ^^Uoe^ ^«*.,ot;«« S416, tfac fik number or file name is automatically 

now charts 01 a camera release operation. . . j . >* .i_ • j . • • . ci 

generated, and in S414, the image data IS wntten into the file. 

Each time the user depresses mode button 61, segments ^^26, the file number or file name is written into the 

"1", "2", "3" and "4" (indicating operation modes) are EEPROM. 

sequentially turned an the LCD panel 65. The user depresses , , , • , c/tic * *u • 1 

J , *-i J • J J u Whenit IS determined in step S415 that the image signal 

the mode button 61 until a desired operation mode number ... , , . u / ci • j j • 

. , , ^ 1 ^ *• ™ ^ IS to be stored in an attribute file, it is recorded m the 

IS turned on to select the operation mode. . • J j - o^i-^r /o^i ox 
^ 25 attribute area of the main file recorded in S426 (S418). 

When the user depresses the release button 63 (S401) j-.^^ „ . „ u *• r*u 

^ . . ^ . FIG. 9 shows a flow chart of the operation of the camera 

after he/she has set the operation mode, the camera reads out t. ■ * n i - j / 

, : . F .. . • 1 * when It IS executing an externally supplied program (e.g. a 

the setting information of the operation mode previously set , , \ n -j j * *u u 

uiv. ^vvnu^xiii 11 y .J,. ^ character recognition program). Provided to the camera by 

in the EEPROM (S402) and proceeds with the camera the PC 
operation in accordance with the setting information. 

, . J First, a preset setting file is read from the recording 

If the mode is detcnnmed to be the built-m program mode ^^^^^ g (ggQ^ ^^^^g ^^j^ information 

in S403 and a natural image recording operation m S404, the ^^^^^ ^^^^^^ ^^^^^^^ ^ s^^ti^g infonnation 

built-in program stored in the ROM 7 will be executed and ^ l^ngu^go to be character-recognized is acquired (S502) 

the signal read from the CCD 3 will be processed in ^ ^^^^^ ^^^^ ^ ^^^^ Izngn^gc is read from the 
accordance with the subsequent set parameters (the number 35 jg^ording medium 8 (S503). 

of record pixels, the number of record bits, the compression ^ • j .i • • 1 • 

J *u ™ \ Then, the exposure is made and an image signal is 

or non-compression and the compression factor) r j ^ *u r-r-r^ ^ . *u tjaxm c /ccnJ^ -ru 

(cAni_cAid\ r / transferred from the CCD 3 to the RAM 6 (S504). The 

^ characters are then extracted, pattern-matched, recognized 

In S405. the CCD 3 makes the exposure, and in S406, the ^nd converted to ASCII code, for example (S505). 

image signal is read out of the CCD 3 and transferred to the 40 r™ r *u ci a a • a- * \ u f 

. o-rtP. 1 • -I- . J J The file name or the file recorded immediately before IS 

RAM 6^ Then, m S407. a luminance signal is generated, and ^^^^ EEPROM 11 (which was written in S426) and 

in S408, whether ,t is a color .mage or a monochromaUc recognized character code is additionally recorded in the 

image is determined, and if it is a color image, a chromi- ^^^^ ^^^^ ^gj^gj 

nance signal is generated and a process proceeds to S310. If ^ ' 

it is the monochromatic image in S408, the process proceeds 45 In accordance with the present embodiment, the retrieval 

directly to S410. In S410, resampling is carried out using a ^^d management of the image file after the image pick-up 

preset number of recorded pixels, and in S411, color con- facilitated, 

version to a preset color space is carried out. In S412, the ^^^^ ^ claimed is: 

signal is compressed to a preset bit length. If compression is 1- ^ electronic camera comprising: 
detected in S413, the compression is carried out in S414 and 50 image pickup means for receiving an image and output- 

the process proceeds to S415. If no compression is delected ting an image signal corresponding thereto; 

in S413, the process proceeds directly to S415. a connector for receiving from an external source (i) 

If the mode is the bar code record mode in S404, the camera mode setting information and (ii) a character 

signal read from the CCD 3 is processed for bar code recognition program; 

recognition (8419^422) according to a built-in program a first memory for storing (i) the received camera mode 

code stored in the ROM 7. setting information and (ii) a file name of the character 

In S419, the CCD 3 makes the exposure, and in S420, the recognition program; 

image signal is read from the CCD 3 and transferred to the a second memory for storing the external source character 

RAM 6. In S421, bar code recognition is carried out and in recognition program received by said connector; 

S422, whether the bar code is to be recorded as video a third memory for storing a built-in photography mode 

information or not is determined. If YES, the process control program; 

proceeds to S407. If NO, the process proceeds directly to a designator for designating one of a photography mode 

S415. and a character recognition mode; and 

Various methods for recording the natural image and 65 signal processing circuitry for processing the image signal 

recognizing the bar code have been proposed and are known, output from said image pickup means (i) as a photo- 

and they are not discussed in detail herein. graph and in accordance with the camera mode setting 



04/07/2004, EAST Version: 1.4.1 



6,040,856 



information stored in said first memory when said 
designating means designates the photography mode, 
and (ii) as character signals when said designating 
means designates the character recognition mode. 
2. A camera according to claim 1, wherein said third 
memory stores a built-in bar code control program, and 
wherein said designator designates a bar code mode, and 
wherein said signal processing circuitry processes the image 
signal as a bar code signal when said designator designates 
the bar code mode. 



3. Apparatxis according to claim 1, further comprising a 
RAM, and wherein said signal processing circuitry transfers 
the character recognition program from said second memory 
to said RAM when said designator designates the character 
recognition mode. 

4. A camera according to claim 1, further comprising a 
cable for coupling said connector to a personal computer 
external source. 
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CERTIFICATE OF CORRECTION 



PATENT NO. : 6,040,856 Page I of 2 

DATED : March 2 1 , 2000 

INVENTOR(S) : Yuji Sakaegi 



It is certified that error appears in the above-identified patent and that said Letters Patent is 
hereby corrected as shown below: 



Assignee: [731 

"Canon Kabushiki Kaisha, Japan" should read -Canon Kabushiki Kaisha, 
Tokyo, Japan--. 

COLUMN 1 

Line 33, ''purpose photograph-recording" should read -photograph-recording 
purpose-. 

Line 52, ^'recording" should read - a recording-. 
COLUMN 4 

Line 1, "the" (second occurrence) should be deleted. 
Line 27, Provided" should read -provided-. 
Line 28, "PC" should read -PC.~. 



04/07/2004, EAST Version: 1.4.1 



UNITED STATES PATENT AND TRADEMARK OFFICE 

CERTIFICATE OF CORRECTION 



PATENT NO. 

DATED 

INVENTOR(S) 



6,040,856 
March 21, 2000 
Yuji Sakaegi 



Page 2 of 2 



It is certified that error appears in the above-identified patent and that said Letters Patent is 
hereby corrected as shown below: 



COLUMN 6 

Line 1 , "Apparatus" should read -- A camera--. 



Signed and Sealed this 
Fifth Day of June, 2001 

NICHOLAS P GODICl 
Acting Director of the United States Patent and Trademark Office 
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